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FEATURE EXTRACTION OF PARTIAL MICROARRAY IMAGES 

BACKGROUND OF THE INVENTION 

The present invention relates to processing of microarray images. In 
5 order to facilitate discussion of the present invention, in following sections, a brief 
description of nucleic-acid-polymer-based microarrays is provided in following 
paragraphs of the current subsection. Although the method and system of the present 
invention may be employed to extract data from any type of microarray, including 
protein-based microarrays and microarrays with natural or synthetic small-molecule, 

10 polymer, or macromolecule-based probes targeting any of a wide range of natural or 
sjmthetic probe-binding target molecules, nucleic-acid-based microarrays are 
currently commonly used, and therefore provide a reasonable basis for examples used 
in following subsections to illustrate the method and system of the present invention. 

Array technologies have gained prominence in biological research and 

15 are likely to become important and widely used diagnostic tools in the healthcare 
industry. Currently, microarray techniques are most often used to determine the 
concentrations of particular nucleic-acid polymers in complex sample solutions. 
Molecular-array-based analytical techniques are not, however, restricted to analysis of 
nucleic acid solutions, but may be employed to analyze complex solutions of any type 

20 of molecule that can be optically or radiometrically scanned and that can bind with 
high specificity to complementary molecules synthesized within, or bound to, discrete 
features on the surface of an array. Because arrays are widely used for analysis of 
nucleic acid samples, the following background information on arrays is introduced in 
the context of analysis of nucleic acid solutions following a brief background of 

25 nucleic acid chemistry. 

Deoxyribonucleic acid ("DNA") and ribonucleic acid ("RNA") are 
linear polymers, each synthesized from four different types of subunit molecules. The 
subunit molecules for DNA include: (1) deoxy-adenosine, abbreviated "A," a purine 
nucleoside; (2) deoxy-thymidine, abbreviated "T," a pyrimidine nucleoside; (3) 

30 deoxy-cytosine, abbreviated "C," a pyrimidine nucleoside; and (4) deoxy-guanosine, 
abbreviated "G," a purine nucleoside. The subunit molecules for RNA include: (1) 
adenosine, abbreviated "A," a purine nucleoside; (2) uracil, abbreviated "U," a 



Docket No. 10030771-1 



pyrimidine nucleoside; (3) cytosine, abbreviated "C," a pyrimidine nucleoside; and 
(4) guanosine, abbreviated "G," a purine nucleoside. Figure 1 illustrates a short DNA 
polymer 100, called an oligomer, composed of the following subunits: (1) deoxy- 
adenosine 102; (2) deoxy-thymidine 104; (3) deoxy-cytosine 106; and (4) deoxy- 
5 guanosine 108. When phosphorylated, subunits of DNA and RNA molecules are 
called "nucleotides" and are linked together through phosphodiester bonds 1 10-1 15 to 
form DNA and RNA polymers. A linear DNA molecule, such as the oligomer shown 
in Figure 1, has a 5* end 118 and a 3' end 120. A DNA polymer can be chemically 
characterized by writing, in sequence from the 5' end to the 3' end, the single letter 

10 abbreviations for the nucleotide subunits that together compose the DNA polymer. 
For example, the oligomer 100 shown in Figure 1 can be chemically represented as 
"ATCG." A DNA nucleotide comprises a purine or pyrimidine base (e.g. adenine 122 
of the deoxy-adenylate nucleotide 102), a deoxy-ribose sugar (e.g. deoxy-ribose 124 
of the deoxy-adenylate nucleotide 102), and a phosphate group (e.g. phosphate 126) 

15 that links one nucleotide to another nucleotide in the DNA polymer. In RNA 
polymers, the nucleotides contain ribose sugars rather than deoxy-ribose sugars. In 
ribose, a hydroxyl group takes the place of the T hydrogen 128 in a DNA nucleotide. 
RNA polymers contain uridine nucleosides rather than the deoxy-thymidine 
nucleosides contained in DNA. The pyrimidine base uracil lacks a methyl group (130 

20 in Figure 1) contained in the pyrimidine base thymine of deoxy-thymidine. 

The DNA polymers that contain the organization information for living 
organisms occur in the nuclei of cells in pairs, forming double-stranded DNA helixes. 
One polymer of the pair is laid out in a 5* to 3' direction, and the other polymer of the 
pair is laid out in a 3' to 5' direction. The two DNA polymers in a double-stranded 

25 DNA helix are therefore described as being anti-parallel. The two DNA polymers, or 
strands, within a double-stranded DNA helix are bound to each other through 
attractive forces including hydrophobic interactions between stacked purine and 
pyrimidine bases and hydrogen bonding between purine and pyrimidine bases, the 
attractive forces emphasized by conformational constraints of DNA polymers. 

30 Because of a number of chemical and topographic constraints, double-stranded DNA 
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helices are most stable when deoxy-adenylate subunits of one strand hydrogen bond 
to deoxy-thymidylate subunits of the other strand, and deoxy-guanylate subunits of 
one strand hydrogen bond to corresponding deoxy-cytidilate subunits of the other 
strand. 

5 Figures 2A-B illustrates the hydrogen bonding between the purine and 

pyrimidine bases of two anti-parallel DNA strands. Figure 2A shows hydrogen 
bonding between adenine and thymine bases of corresponding adenosine and 
thymidine subunits, and Figure 2B shows hydrogen bonding between guanine and 
cytosine bases of corresponding guanosine and cytosine subunits. Note that there are 
10 two hydrogen bonds 202 and 203 in the adenine/thymine base pair, and three 
hydrogen bonds 204-206 in the guanosine/cytosine base pair, as a result of which GC 
base pairs contribute greater thermodynamic stability to DNA duplexes than AT base 
pairs. AT and GC base pairs, illustrated in Figures 2A-B, are known as Watson-Crick 
("WC") base pairs. 

15 Two DNA strands linked together by hydrogen bonds forms the 

familiar helix structure of a double-stranded DNA helix. Figure 3 illustrates a short 
section of a DNA double helix 300 comprising a first strand 302 and a second, anti- 
parallel strand 304. The ribbon-like strands in Figure 3 represent the deoxyribose and 
phosphate backbones of the two anti-parallel strands, with hydrogen-bonding purine 

20 and pyrimidine base pairs, such as base pair 306, interconnecting the two strands. 
Deoxy-guanylate subunits of one strand are generally paired with deoxy-cytidilate 
subunits from the other strand, and deoxy-thymidilate subunits in one strand are 
generally paired with deoxy-adenylate subunits firom the ottier strand. However, non- 
WC base pairings may occur within double-stranded DNA. 

25 Double-stranded DNA may be denatured, or converted into single 

stranded DNA, by changing the ionic strength of the solution containing the double- 
stranded DNA or by raising the temperature of the solution. Single-stranded DNA 
polymers may be renatured, or converted back into DNA duplexes, by reversing the 
denaturing conditions, for example by lowering the temperature of the solution 

30 containing complementary single-stranded DNA polymers. During renaturing or 
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hybridization, complementary bases of anti-parallel DNA strands form WC base pairs 
in a cooperative fashion, leading to reannealing of the DNA duplex. Strictly A-T and 
G-C complementarity between anti-parallel polymers leads to the greatest 
thermodjoiamic stability, but partial complementarity including non-WC base pairing 
5 may also occur to produce relatively stable associations between partially- 
complementary polymers. In general, the longer the regions of consecutive WC base 
pairing between two nucleic acid polymers, the greater the stability of hybridization 
between the two polymers under renaturing conditions. 

The ability to denature and renature double-stranded DNA has led to 

10 the development of many extremely powerful and discriminating assay technologies 
for identifying the presence of DNA and RNA polymers having particular base 
sequences or containing particular base subsequences within complex mixtures of 
different nucleic acid polymers, other biopolymers, and inorganic and organic 
chemical compounds. One such methodology is the array-based hybridization assay. 

15 Figures 4-7 illustrate the principle of the array-based hybridization assay. An array 
(402 in Figure 4) comprises a substrate upon which a regular pattern of features is 
prepared by various manufacturing processes. The array 402 in Figure 4, and in 
subsequent Figures 5-7, has a grid-like 2-dimensional pattern of square features, such 
as feature 404 shown in the upper left-hand comer of the array. Each feature of the 

20 array contains a large number of identical oligonucleotides covalently bound to the 
surface of the feature. These bound oligonucleotides are known as probes. In 
general, chemically distinct probes are bound to the different features of an array, so 
that each feature corresponds to a particular nucleotide sequence. In Figures 4-6, the 
principle of array-based hybridization assays is illustrated with respect to the single 

25 feature 404 to which a number of identical probes 405-409 are bound. In practice, 
each feature of the array contains a high density of such probes but, for the sake of 
clarity, only a subset of these are shown in Figures 4-6. 

Once an array has been prepared, the array may be exposed to a sample 
solution of target DNA or RNA molecules (410-413 in Figure 4) labeled with 

30 fluorophores, chemiluminescent compounds, or radioactive atoms 415-418. Labeled 
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target DNA or RNA hybridizes through base pairing interactions to the 
complementary probe DNA, synthesized on the surface of the array. Figure 5 shows a 
number of such target molecules 502-504 hybridized to complementary probes 505- 
507, which are in turn bound to the surface of the array 402. Targets, such as labeled 
5 DNA molecules 508 and 509, that do not contains nucleotide sequences 
complementary to any of the probes bound to array surface do not hybridize to 
generate stable duplexes and, as a result, tend to remain in solution. The sample 
solution is then rinsed from the surface of the array, washing away any unbound- 
labeled DNA molecules. In other embodiments, unlabeled target sample is allowed to 

10 hybridize with the array first. Typically, such a target sample has been modified with 
a chemical moiety that will react with a second chemical moiety in subsequent steps. 
Then, either before or after a wash step, a solution containing the second chemical 
moiety bound to a label is reacted with the target on the array. After washing, the 
array is ready for scanning. Biotin and avidin represent an example of a pair of 

1 5 chemical moieties that can be utilized for such steps. 

Finally, as shown in Figure 6, the bound labeled DNA molecules are 
detected via optical or radiometric scanning. Optical scanning involves exciting 
labels of bound labeled DNA molecules with electromagnetic radiation of appropriate 
frequency and detecting fluorescent emissions from the labels, or detecting light 

20 emitted from chemiluminescent labels. When radioisotope labels are employed, 
radiometric scanning can be used to detect the signal emitted from the hybridized 
features. Additional types of signals are also possible, including electrical signals 
generated by electrical properties of bound target molecules, magnetic properties of 
bound target molecules, and other such physical properties of bound target molecules 

25 that can produce a detectable signal. Optical, radiometric, or other types of scanning 
produce an analog or digital representation of the array as shown in Figure 7, with 
features to which labeled target molecules are hybridized similar to 706 optically or 
digitally differentiated from those features to which no labeled DNA molecules are 
bound. In other words, the analog or digital representation of a scanned array displays 

30 positive signals for features to which labeled DNA molecules are hybridized and 
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displays negative features to which no, or an undetectably small number of, labeled 
DNA molecules are bound. Features displaying positive signals in the analog or 
digital representation indicate the presence of DNA molecules with complementary 
nucleotide sequences in the original sample solution. Moreover, the signal intensity 
5 produced by a feature is generally related to the amount of labeled DNA bound to the 
feature, in turn related to the concentration, in the sample to which the array was 
exposed, of labeled DNA complementary to the oligonucleotide within the feature. 

When a microarray is scanned, data may be collected as a two- 
dimensional digital image of the microarray, each pixel of which represents the 

10 intensity of phosphorescent, fluorescent, chemiluminescent, or radioactive emission 
from an area of the microarray corresponding to the pixel. A microarray data set may 
comprise a two-dimensional image or a list of numerical, alphanumerical pixel 
intensities, or any of many other computer-readable data sets. An initial series of 
steps employed in processing digital microarray images includes constructing a 

15 regular coordinate system for the digital image of the microarray by which the 
features within the digital image of the microarray can be indexed and located. For 
example, when the features are laid out in a periodic, rectilinear pattern, a rectilinear 
coordinate system is commonly constructed so that the positions of the centers of 
features lie as closely as possible to intersections between horizontal and vertical 

20 gridlines of the rectilinear coordinate system, alternatively, exactly half-way between 
a pair of adjacent horizontal and a pair of adjacent vertical grid lines. Then, regions 
of interest ("ROIs") are computed, based on the initially estimated positions of the 
features in the coordinate grid, and centroids for the ROIs are computed in order to 
refine the positions of the features. Once the position of a feature is refined, feature 

25 pixels can be differentiated from background pixels within the ROI, and the signal 
corresponding to the feature can then be computed by integrating the intensity over 
the feature pixels. 

Following exposure of a microarray to a sample solution, the entire 
feature-containing surface of the microarray may not be suitable for feature extraction 
30 for a variety of reasons. Portions of the array may be damaged by mishandling. 
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portions of the array may be inadvertently contaminated or otherwise chemically 
modified during experimental procedures, there may be manufacturing defects present 
in portions of the microarray, and there may be other, similar problems that prevent 
portions of the microarray surface from being accurately scanned. Currently, when a 
5 user identifies damaged or defective portions of a microarray, the user needs to 
laboriously identify those features within the damaged, defective, or otherwise 
compromised subregions and manually edit a design file in order to eliminate the 
features within the compromised subregions from consideration by an automated 
feature extraction program. The manual, design-file-editing procedure is both time 
10 consuming and prone to error. For this reason, designers, manufactures, and users of 
microarray processing and feature extraction systems have recognized the need for a 
more user-friendly method for identifying featxires within compromised subregions of 
a microarray and removing those features from consideration by automated feature 
extraction programs. 

15 

SUMMARY OF THE INVENTION 

In one embodiment of the present invention, an automated microarray 
processing system displays, to a user, a visual rendering of the scanned image of a 
microarray, including putative feature locations, prior to undertaking automated 

20 feature extraction. The microarray processing system provides to the user an ability 
to draw one or more contour lines around those portions of the microarray considered 
by the user to be undamaged, non-defective, and otherwise not compromised and 
therefore suitable for feature extraction. The microarray processing system then 
constructs one or more rectangular regions of feature extractability based on the user- 

25 indicated subregions of feature extractability, and proceeds to extract data from the 
one or more rectangular regions of feature extractability. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 illustrates a short DNA polymer. 



30 
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Figure 2A shows hydrogen bonding between adenine and thymine 
bases of corresponding adenosine and thymidine subunits. 

Figure 2B shows hydrogen bonding between guanine and cytosine 
5 bases of corresponding guanosine and cytosine subunits. 

Figure 3 illustrates a short section of a DNA double helix. 

Figures 4-7 illustrate the principle of array-based hybridization assays. 

10 

Figure 8 shows a hypothetical computer display of a scanned image of 

a microarray. 



Figure 9 illustrates a visual display of a scanned image of a microarray 
1 5 containing two damaged or defective regions. 

Figure 10 illustrates editing of a design file. 

Figure 11 illustrates one method by which a user may identify a 
20 subregion of a microarray suitable for feature extraction. 

Figure 12 shows the subregion of Figure 11, bounded by a contour 
line, at greater magnification, superimposed over a pixel grid. 

25 Figures 13A-B illustrate nearest-neighbor analysis of pixels within the 

contour identified by a user as enclosing a subregion of a microarray suitable for 
feature extraction. 



Figure 14 illustrates the pixel intensities in pixels included in, and 
30 surrounding, a putative feature. 
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Figures 15-18 illustrate nearest-neighbor analysis for individual pixels 
within and near the putative feature, shown in Figure 14, and in a defective or 
damaged region. 

5 Figure 19 illustrates a hypothetical bit mask prepared for the user- 

identified feature-extractable subregion of Figures 11, 12, and 13A-B. 

Figure 20 illustrates computation of the sums of the binary mask 
values along vertical columns with respect to the x and y coordinate axes shown in 
10 Figure 19. 

Figure 21 illustrates summing of the binary-mask values within 
horizontal columns with respect to the x and 3; coordinate axes shown in Figure 19. 

15 Figure 22 shows the bounding rectangle 2202 computed for the user- 

defined feature-extractable subregion 1902 within contour 1402. 

Figure 23 illustrates computation of a center of mass of the binary 
mask prepared from the user-defined feature-extractable subregion is computed. 

20 

Figure 24 illustrates one approach to computing feature-extractable 
regions for multiple user-defined feature-extractable regions. 

Figure 25 is a control-flow diagram for the partial microarray 
25 technique described above with reference to Figures 1 1-25. 

DETAILED DESCRIPTION OF THE INVENTION 

Various embodiments of the present invention allow a user to specify 
subregions of a microarray that the user feels are undamaged, non-defective, and 
30 otherwise non-compromised, and therefore suitable for automated feature extraction. 
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10 

Embodiments of the present invention are described, below, following a first 
subsection that provides additional information about microarrays. 

Additional Information About Microarravs 

5 

An array may include any one-, two- or three-dimensional arrangement 
of addressable regions, or features, each bearing a particular chemical moiety or 
moieties, such as biopolymers, associated with that region. Any given array substrate 
may carry one, two, or four or more arrays disposed on a front surface of the 

10 substrate. Depending upon the use, any or all of the arrays may be the same or 
different from one another and each may contain multiple spots or features. A typical 
array may contain more than ten, more than one hundred, more than one thousand, 
more ten thousand features, or even more than one hundred thousand features, in an 
area of less than 20 cm^ or even less than 10 cm^. For example, square features may 

15 have widths, or round feature may have diameters, in the range from a 10 ^mi to 1.0 
cm. In other embodiments each feature may have a width or diameter in the range of 
1.0 pm to 1.0 mm, usually 5.0 ^m to 500 (xm, and more usually 10 (xm to 200 |im. 
Features other than round or square may have area ranges equivalent to that of 
circular features with the foregoing diameter ranges. At least some, or all, of the 

20 features may be of different compositions (for example, when any repeats of each 
feature composition are excluded the remaining features may account for at least 5%, 
10%, or 20% of the total number of features). Inter-feature areas are typically, but not 
necessarily, present Inter-feature areas generally do not carry probe molecules. Such 
inter-feature areas typically are present where the arrays are formed by processes 

25 involving drop deposition of reagents, but may not be present when, for example, 
photolithographic array fabrication processes are used. When present, interfeature 
areas can be of various sizes and configurations. 

Each array may cover an area of less than 100 cm^, or even less than 
50 cm^, 10 cm^ or 1 cm^. In many embodiments, the substrate carrying the one or 

30 more arrays will be shaped generally as a rectangular solid having a length of more 
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than 4 mm and less than 1 m, usually more than 4 mm and less than 600 mm, more 
usually less than 400 mm; a width of more than 4 mm and less than 1 m, usually less 
than 500 mm and more usually less than 400 mm; and a thickness of more than 0.01 
mm and less than 5.0 mm, usually more than 0.1 mm and less than 2 mm and more 
5 usually more than 0.2 and less than 1 mm. Other shapes are possible, as well. With 
arrays that are read by detecting fluorescence, the substrate may be of a material that 
emits low fluorescence upon illumination with the excitation light. Additionally in 
this situation, the substrate may be relatively transparent to reduce the absorption of 
the incident illuminating laser light and subsequent heating if the focused laser beam 

10 travels too slowly over a region. For example, a substrate may transmit at least 20%, 
or 50% (or even at least 70%, 90%, or 95%), of the illuminating light incident on the 
front as may be measured across the entire integrated spectrum of such illimiinating 
light or alternatively at 532 nm or 633 nm. 

Arrays can be fabricated using drop deposition from pulsejets of either 

1 5 polynucleotide precursor units (such as monomers) in the case of in situ fabrication, 
or the previously obtained polynucleotide. Such methods are described in detail in, 
for example, US 6,242,266, US 6,232,072, US 6,180,351, US 6,171,797, US 
6,323,043, U.S. Patent Application Serial No. 09/302,898 filed April 30, 1999 by 
Caren et al., and the references cited therein. Other drop deposition methods can be 

20 used for fabrication, as previously described herein. Also, instead of drop deposition 
methods, photolithographic array fabrication methods may be used such as described 
in US 5,599,695, US 5,753,788, and US 6,329,143. Interfeature areas need not be 
present particularly when the arrays are made by photolithographic methods as 
described in those patents. 

25 A molecular array is typically exposed to a sample including labeled 

target molecules, or, as mentioned above, to a sample including unlabeled target 
molecules followed by exposure to labeled molecules that bind to unlabeled target 
molecules bound to the array, and the array is then read. Reading of the array may be 
accomplished by illuminating the array and reading the location and intensity of 

30 resulting fluorescence at multiple regions on each feature of the array. For example, a 
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scanner may be used for this purpose, which is similar to the AGILENT 
MICROARRAY SCANNER manufactured by Agilent Technologies, Palo Alto, CA. 
Other suitable apparatus and methods are described in U.S. patent applications: Serial 
No. 10/087447 "Reading Dry Chemical Arrays Through The Substrate" by Corson et 
5 al., and Serial No. 09/846125 "Reading Multi-Featured Arrays" by Dorsel et al. 
However, arrays may be read by any other mediod or apparatus than the foregoing, 
with other reading methods including other optical techniques, such as detecting 
chemiluminescent or electroluminescent labels, or electrical techniques, for where 
each feature is provided with an electrode to detect hybridization at that feature in a 

10 manner disclosed in US 6,25 1,685, US 6,221 ,583 and elsewhere. 

A result obtained from reading an array, followed by application of a 
method of the present invention, may be used in that form or may be further processed 
to generate a result such as that obtained by forming conclusions based on the pattern 
read from the array, such as whether or not a particular target sequence may have 

15 been present in the sample, or whether or not a pattern indicates a particular condition 
of an organism from which the sample came. A result of the reading, whether further 
processed or not, may be forwarded, such as by communication, to a remote location 
if desired, and received there for further use, such as for further processing. When 
one item is indicated as being remote from another, this is referenced that the two 

20 items are at least in different buildings, and may be at least one mile, ten miles, or at 
least one hundred miles apart. Communicating information references transmitting 
the data representing that information as electrical signals over a suitable 
communication chaimel, for example, over a private or public network. Forwarding 
an item refers to any means of getting the item from one location to the next, whether 

25 by physically transporting that item or, in the case of data, physically transporting a 
medium carrying the data or communicating the data. 

As pointed out above, array-based assays can involve other types of 
biopolymers, synthetic polymers, and other types of chemical entities. A biopolymer 
is a polymer of one or more types of repeating units. Biopolymers are typically found 

30 in biological systems and particularly include polysaccharides, peptides, and 
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polynucleotides, as well as their analogs such as those compounds composed of, or 
containing, amino acid analogs or non-amino-acid groups, or nucleotide analogs or 
non-nucleotide groups. This includes polynucleotides in which the conventional 
backbone has been replaced with a non-naturally occurring or synthetic backbone, and 
5 nucleic acids, or synthetic or naturally occurring nucleic-acid analogs, in which one or 
more of the conventional bases has been replaced with a natural or synthetic group 
capable of participating in Watson-Crick-type hydrogen bonding interactions. 
Polynucleotides include single or multiple-stranded configurations, where one or 
more of the strands may or may not be completely aligned with another. For 

10 example, a biopolymer includes DNA, RNA, oligonucleotides, and PNA and other 
polynucleotides as described in US 5,948,902 and references cited therein, regardless 
of the source. An oUgonucleotide is a nucleotide multimer of about 10 to 100 
nucleotides in length, while a polynucleotide includes a nucleotide multimer having 
any number of nucleotides. 

15 As an example of a non-nucleic-acid-based molecular array, protein 

antibodies may be attached to features of the array that would bind to soluble labeled 
antigens in a sample solution. Many other types of chemical assays may be facilitated 
by array technologies. For example, polysaccharides, glycoproteins, synthetic 
copolymers, including block copolymers, biopolymer-like polymers with synthetic or 

20 derivitized monomers or monomer linkages, and many other types of chemical or 
biochemical entities may serve as probe and target molecules for array-based analysis. 
A fundamental principle upon which arrays are based is that of specific recognition, 
by probe molecules affixed to the array, of target molecules, whether by sequence- 
mediated binding affinities, binding affinities based on conformational or topological 

25 properties of probe and target molecules, or binding affinities based on spatial 
distribution of electrical charge on the surfaces of target and probe molecules. 

Scanning of a molecular array by an optical scaiming device or 
radiometric scanning device generally produces a scanned image comprising a 
rectilinear grid of pixels, with each pixel having a corresponding signal intensity. 

30 These signal intensities are processed by an array-data-processing program that 
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analyzes data scanned from an array to produce experimental or diagnostic results 
which are stored in a computer-readable medium, transferred to an 
intercommunicating entity via electronic signals, printed in a human-readable format, 
or otherwise made available for further use. Molecular array experiments can indicate 
5 precise gene-expression responses of organisms to drugs, other chemical and 
biological substances, environmental factors, and other effects. Molecular array 
experiments can also be used to diagnose disease, for gene sequencing, and for 
analytical chemistry. Processing of molecular-array data can produce detailed 
chemical and biological analyses, disease diagnoses, and other information that can be 
10 stored in a computer-readable medium, transferred to an intercommunicating entity 
via electronic signals, printed in a human-readable format, or otherwise made 
available for further use. 

Embodiments Of The Present Invention 

15 

Figure 8 shows a hypothetical computer display of a scanned image of 
a microarray. In the hypothetical scanned image of the microarray, shown in Figure 
8, a rectangular microarray 802 includes closely spaced features, such as feature 804, 
residing at putative feature positions obtained from a design file, or visible in a color 

20 or shading-based representation of the intensities of pixels within the scanned image 
of the microarray 802. Thus, the features indicated in the display shown in Figure 8 
may or may not correspond with actual features that would be extracted from the 
image by automated feature extraction procedures. 

Following exposure of a microarray to a sample solution, the entire 

25 feature-containing surface of the microarray may not be suitable for feature extraction 
for a variety of reasons. Portions of the array may be damaged by mishandling, 
portions of the array may be inadvertently contaminated or otherwise chemically 
modified during experimental procedures, there may be manufacturing defects present 
in portions of the microarray, and there may be other, similar problems that prevent 

30 portions of the microarray surface from being accurately scanned. Often, the portions 
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of a microarray that are not suitable for feature extraction may be visually identified 
by a user based on a visual display of the scanned image of the microarray. For 
example. Figure 9 illustrates a visual display of a scanned image of a microarray 
when a computer screen, in which a user may readily identify two regions 904 and 
5 906, shown in Figure 9 with crosshatching, with intensities either lower, higher, or 
with different variation, than in the undamaged and undefective, viable portion of the 
microarray 908 from which accurate data can be extracted via an automated feature 
extraction program. 

Currently, when a user identifies damaged or defective portions of a 

10 microarray, such as subregions 904 and 906 in the visual display of a scanned image 
of a microarray 902 in Figure 9, the user needs to laboriously identify those features 
within the damaged, defective, or otherwise compromised subregions and manually 
edit a design file in order to eliminate the features within the compromised subregions 
from consideration by an automated feature extraction program. A design file is a 

15 computer file or computer database with records or entries for each feature in a 
microarray. Figure 10 illustrates editing of a design file. In Figure 10, the file or 
database is represented as a sequence of records, or entries 1002. A particular record 
or entry, such as record or entry 1004, may be accessed by feature number, feature 
index, a text rendering of the probe sequence or identity of the intended target for the 

20 feature, or by some other, similar means. The record or entry contains a number of 
fields, each field consisting of one or more computer-readable bits, bytes, words, or 
arrays of bits, bytes, or words. For example, a record or entry may include integer 
fields 1006 and 1008 specifying the indices of the feature within the microarray, a text 
field 1010 containing the name of the target of the feature, integer fields that identify 

25 the subsequence of the target to which the probe molecule in the feature is 
complementary 1012 and 1014, a text field including the probe sequence 1016, a text 
field identifying the organism from which the target molecule is obtained 1018, a 
number of bit fields, such as bit field 1020 that indicates whether or not the feature is 
valid, or useable, and additional fields 1022-1025 which are used to store signal data 

30 for the feature following automated feature extraction. The computer-readable record 
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or entry 1004 may be rendered for visual display 1026 and displayed to a user by a 
design-file editor. In order to remove features contained within damaged or defective 
subregions of a microarray, a user currently needs to identify the features within those 
compromised subregions, access the records or entries corresponding to the features 
5 through a design-file editor, and edit the contents of the record or feature to indicate 
that the feature should not be considered by an automated feature extraction program. 
In the example of Figure 10, the user would move a cursor 1028 to highlight an 
alphanumeric 1030 rendering of a bit field in order to designate the feature as not 
valid. 

10 Various embodiments of the present invention allow a user to identify 

one or more subregions of a microarray suitable for feature extraction. Figure 1 1 
illustrates one method by which a user may identify a subregion of a microarray 
suitable for feature extraction. In Figure 11, a user has drawn a contour line 1102 
about a subregion 1 104 of a microarray visually displayed 1 106 on a computer screen. 

15 In one embodiment, the user employs a touchscreen to manually draw the one or more 
contour lines directly on the visually displayed image of a microarray. In alternative 
embodiments, navigational keys on a computer keyboard are used to initiate, steer, 
and terminate entry of a contour line via cursor movement. Many other alternative 
means for providing a user the ability to input a contour line may be employed in 

20 additional, altemative embodiments. It should be noted that thousands or tens of 
thousands of putative feature positions may be present within the scatmed image of a 
microarray. Therefore, visual display of the scanned image of a microarray normally 
involves zooming operations, allowing a user to visualize the entire scarmed image of 
the microarray, to navigate to particular portions of the microarray, and to change the 

25 scale of presentation in order to view putative feature positions at magnifications 
levels at which individual pixels are evident. Figures 8, 9, and 1 1 employ a very 
small number of features for clarity of illustration. Note also that the drawing of a 
contour line by a user may involve a number of navigational and zooming operations 
to allow the user to precisely place the contour line to surround one or more regions 

30 that appear to be suitable for feature extraction. 
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Figure 12 shows the subregion bounded by a contour line, shown in 
Figure 11, at greater magnification, superimposed over a pixel grid. Again, in a 
normal microarray, each putative feature location may include a much larger number 
of pixels than the putative features, indicated in Figure 12 by circular dashed lines, 
5 such as circular dashed line 1202. A relatively large pixel grid, and a correspondingly 
small number of pixels per putative feature, are used in Figure 12 and subsequent 
figures for clarity of illustration. The subregion suitable for feature extraction 1204 
has been rotated by 90 degrees in a counter-clockwise direction from the display in 
Figure 1 1 . 

10 Embodiments of the present invention employ pixel-based analysis 

techniques in order to transform an irregularly shaped region identified by a user as 
suitable for feature extraction, such as region 1204 in Figure 12, into an easily 
described, regular region, such as a rectangular region. Irregular regions are not 
easily described mathematically or algorithmically, and often have low symmetry, 

15 two quite related aspects. Quite often, an irregular region needs to be described by a 
curved perimeter, generally by a large set of points at reasonable intervals along the 
perimeter, the interval length needed, or needed resolution, depending on the 
maximum curvature of the perimeter. Regular regions, by contrast, have relatively 
high symmetry, and can be easily described mathematically and/or algorithmically. 

20 For example, it is very difficult to determine an analytical function or a simple 
algorithm to describe or construct a misshapen blob. By contrast, a square can be 
simply described by the coordinates of two, particular vertices. 

In certain embodiments of the present invention, a bit mask, with each 
bit representing a single pixel within the scanned image of the microarray, is prepared 

25 for the identified subregion or subregions suitable for feature extraction. The bit map 
is prepared by successive analysis of each pixel within the scanned image of the 
microarray. As discussed above, each pixel in the scanned image of a microarray 
represents a square or rectangular subregion of the microarray and is associated with 
an intensity value, for a one-channel microarray, or a number of intensity values for a 

30 multi-channel microarray. In the following, analysis of a subregion is described with 
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reference to a single intensity value, or single channel, for each pixel. In alternative 
embodiments, separate analyses may be undertaken for each channel, or set of 
intensity values, and the intersection of the resulting rectangular regions employed for 
feature extraction. In other alternative embodiments, the intensity signals may be 
5 combined to produce a combined intensity signal on which the analysis, described 
below, is carried out. In additional, alternative embodiments, separately determined 
rectangular subregions suitable for feature extractability in each channel may be used 
for feature extraction of the corresponding intensity sets, resulting in some number of 
features extracted in only one, or a subset of, \multiple channels or intensity sets. 

10 In one technique for intensity-based analysis, the intensities of a 

number of neighboring pixels within a square neighborhood of a pixel under 
consideration are considered in order to determine whether or not the pixel under 
consideration should be set to the binary value "1" in a bit mask, or set to the binary 
value "0." Either of two binary conventions can be used. In the current discussion, a 

15 binary value "1" indicates that the pixel appears, based on the intensities of its 
neighbors, to be included in a subregion of the microarray suitable for feature 
extractability. The neighborhood for a pixel may include the eight nearest neighbors 
within a square region centered about the considered pixel, may consist of the 24 
nearest in a square region centered about the considered pixel, or may consist of some 

20 other number of nearest neighbor pixels in a more complex area that includes the 
considered pixel. 

Figures 13A-B illustrate nearest-neighbor analysis of pixels within the 
contour identified by a user as enclosing a subregion of a microarray suitable for 
feature extraction. The pixels within the contour are each considered in a normal, 

25 left-to-right, top-down, raster-like scan of the region bounded by the contour line. As 
shown in Figure 13 A, the eight nearest neighbors within a square region 1302 
centered about flie first pixel 1304 encountered in the raster-like scan of the region 
within the contour are considered in order to determine whether or not the value for 
the first pixel 1304 in the binary mask should be set to "1" or "0." Then, in a next 

30 step of the raster-like scab, as shown in Figure 13B, the nearest-neighbor square 1302 
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is shifted one pixel to the right in order to consider a next pixel 1306. The nearest- 
neighbor analysis proceeds with each subsequent pixel within the subregion enclosed 
by the contour line 1204. 

Figure 14 illustrates the pixel intensities in pixels included in, and 
5 surrounding, a putative feature. In Figure 14, the putative feature location is indicated 
by circle 1402. The number in each square of the grid, such as the number "3" in 
square 1404, represents the intensity value for the pixel represented by the square 
within the grid. Note that the intensities of pixels within the putative feature area, 
such as the intensity "111" within pixel 1406, are generally higher than the intensities 
10 of the pixels outside the putative feature area. In other words, the putative feature 
area 1402 in fact corresponds to an area of a feature in the scanned image of a 
microarray. 

Figures 15-18 illustrate nearest-neighbor analysis for individual pixels 
within and near the putative feature, shown in Figure 14, and in a defective or 

15 damaged region. In Figure 15, the neighborhood 1502 of a pixel 1504 within the 
putative feature 1402 is considered. The intensities of the eight neighbors of the 
central pixel 1504 within the neighborhood 1502 are sorted in the array 1506 by 
intensity value. The average pixel intensity value for the eight nearest neighbors of 
pixel 1504 is computed as "101.5." Then, the array of pixel-intensity values 1506 is 

20 searched to find a position within the array representing the computed average value 
"101.5." As shown in Figure 15, that position 1508 falls between the lowest pixel 
intensity value 52 (1510) and the next lowest pixel intensity value "104" (1512). In a 
number of embodiments of the present invention, the decision whether to include a 
pixel, such as pixel 1504, in the binary mask computed from the pixel intensity data 

25 or, in other words, to set the bit corresponding to the pixel within the binary mask to 
binary value "1," is determined by the position of the computed average value within 
the sorted array. In the currently described embodiment, if at least half of the pixel- 
intensity values in the sorted array are greater than the computed average value, then 
the binary value for the considered pixel is set to binary value "1." Otherwise, the 

30 binary value for the considered pixel is set to binary value "0." In the case of Figure 
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15, all but one of the nearest neighbor pixel intensity values are greater than the 
computed average value, and so the binary value "1" would be set in the bit of the bit 
mask corresponding to pixel 1504. 

Figure 16 illustrates nearest neighbor analysis for central pixel 1602 
5 within neighborhood 1604. Again, more than half of the nearest neighbor pixel 
intensities are greater than the computed average intensity "109.6." Figure 17 
illustrates the nearest neighbor analysis for a pixel 1702 near the edge of the putative 
feature 1402. An eight-neighbor nearest neighbor analysis based on neighborhood 
1704 is shown by the sorted array 1706 of pixel intensity values from the eight- 

10 neighbor neighborhood 1704. More than half of the intensities associated with the 
eight nearest neighbor pixels have intensity values greater than the computed average 
pixel intensity value for tiie eight nearest neighbors "62.6." Alternatively, a nearest 
neighbor analysis may be conducted over the neighborhood 1708 that includes 24 
nearest neighbors of the central pixel 1702. The pixel intensities of the 24 nearest 

15 neighbors are sorted into array 1710. Again, more than half of the pixel intensity 
values are greater than the computed average pixel intensity value "55.6" for the 24 
nearest neighbors. Thus, central pixel 1702 would have the corresponding binary bit- 
mask value "1." 

Figure 18 shows a small, square area 1082 of pixels from a subregion 
20 of the microarray that is damaged, defective, or otherwise unsuitable for feature 
extraction. As can be seen in Figure 18, the pixel intensity values within the region 
have a rather skewed distribution, with many low-intensity pixels and a few, 
randomly distributed, rather higher intensity pixels. Nearest neighbor analysis for 
pixel 1804 based on either the eight-neighbor neighborhood 1806 or the 24-neighbor 
25 neighborhood 1808 results in a determination that the central pixel 1804 should have 
a corresponding binary value "0" in the binary mask. Only two of six pixel intensity 
values for the eight nearest neighbors of neighborhood 1806 have values greater than 
the computed average pixel intensity for the eight nearest neighbors, shown sorted in 
array 1810, and only six of the 24 nearest neighbors of neighborhood 1808 have pixel 
30 intensity values greater than the computed average pixel intensity value "4.25." 
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In the above-described embodiment, the determination of whether a 
pixel belongs to a feature-extractable subregion or not is related to whether or not the 
computed average pixel intensity value for the nearest neighbors of the pixel is equal 
to, or less than, the median pixel intensity value. This method, or metric, is tailored to 
5 identifying pixels within regions, such as the region 1 802 in Figure 18, in which a few 
relatively high intensity pixels are scattered amongst a large number of relatively low- 
intensity pixels. This type of pixel intensity distribution is symptomatic of damaged 
or defective microarray subregions for a class of microarrays for which the above- 
described embodiment has been developed. Other types of nearest neighbor analyses 

10 may be employed in alternative embodiments. For example, the decision as to 
whether include or exclude a particular pixel from the binary mask may be based on 
the variance of pixel intensities within a neighborhood including the pixel, on a 
comparison of the pixers intensity with the intensities of its nearest neighbors, or on 
any number of other types of tests or metrics that appropriately discriminate, based on 

15 neighboring pixels, pixels belonging to feature-extractable subregions from pixels 
belonging to defective or damaged subregions. In additional, alternative 
embodiments, more global approaches to the analysis may be used, including 
employing larger neighborhoods, computing bit-mask values for groups of pixels, and 
other techniques. 

20 Whether by eight-neighbor nearest neighbor analysis, 24-neighbor 

nearest neighbor analysis, or other pixel-intensity analyses, a bit mask for the feature- 
extractable subregion or subregions identified by a user are prepared. Figure 19 
illustrates a hypothetical bit mask prepared for the user-identified feature-extractable 
subregion of Figures 11, 12, and 13A-B. As shown in Figure 19, each pixel within a 

25 user-identified feature-extractable subregion 1902 has been assigned either the binary 
value "1" or the binary value "0." A horizontal axis x 1904 and a vertical axis;; 1906, 
both incremented in pixels, are assigned within the pixel grid to allow for local 
indexing of each pixel within the binary mask. Figure 20 illustrates computation of 
the sums of the binary mask values along vertical columns with respect to the x and y 

30 coordinate axes shown in Figure 19. For example, the column of height 4 2002 
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appearing in Figure 20 corresponds to vertical pixel column 1908 in Figure 19 which 
includes four pixels having the binary value "1" 1910-1913. Similarly, column 2004 
in Figure 20 corresponds to the sum of the values in vertical column 1914 in Figure 
19. Figure 21 illustrates summing of the binary-mask values within horizontal 
5 columns with respect to the x and 3/ coordinate axes shown in Figure 19. For example, 
column 2102 in Figure 21 of height 3 corresponds to the sum of the binary-mask 
values in horizontal row 1916 in Figure 19. Similarly, column 2104 in Figure 21, of 
height 6, corresponds to the sum of the binary-mask values in horizontal row 1918. 
The width and height of a bounding rectangle are computed from the plots of column 

10 and row sums shown in Figures 20 and 21, respectively. In both cases, one half of a 
height of the largest column or row value is calculated, and a horizontal line of that 
height, 2006 and 2108, respectively, is plotted. The left-hand position of the 
bounding rectangle is obtained as the first column, in Figure 20, having a value 
greater than the one-half maximum column height value, column 2008. The right- 

15 hand position for the bounding rectangle is computed as the final column with height 
s greater flian the one-half maximum height value, column 2010. Similarly, as shown 

in Figure 21, the lower-most boundary for the bounding rectangle is computed as the 
position of the first column 2110 with height greater than the computed one-half 
maximum height 2108, and the upper position of the bounding rectangle is computed 

20 as the final column 2112 with height greater than the computed one-half maximum 
height 2108. 

Figure 22 shows the bounding rectangle 2202 computed for the user- 
defined feature-extractable subregion 1902 within contour 1402. The bounding 
rectangle is shown in Figure 22 as a crosshatched rectangle 2202. The x-dods 

25 positions of the left and right vertical sides of the bounding rectangle 2202 correspond 
to the computed x-coordinate positions 2008 and 2010 shown in Figure 20, and thej;- 
axis positions of the lower and upper edges of the bounding rectangle correspond to 
the computed jv-coordinate positions 2110 and 2112 in Figure 21. The bounding 
rectangle 2202 corresponds to a rectangular subregion with the greatest density of 

30 binary values "1" within the binary mask. A rectangular subregion is computed 
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because a rectangular subregion is easily described by two x-coordinate and two 
coordinate values 2008, 2010, 2110, and 2112 in Figure 22. 

Next, as shown in Figure 23, the center of mass of the binary mask 
prepared from the user-defined feature-extractable subregion is computed. The 
coordinates i^x^^y^) of the center of mass may be computed as: 

=^ 

n 

y.=^ 

n 

where x. and y^ are the jc and y coordinates for the binary mask value corresponding to 
pixel I, n is the number of pixels within the user-defined subregion, and M. is the 
value in the binary mask corresponding to pixel /. In Figure 23, the center of mass of 
the binary mask prepared from the user-defined feature-extractable subregion 
coincides with point 2302. The originally computed bounding rectangle 2202 is then 
moved so that the center of the bounding rectangle coincides with the computed 
center of mass 2302, As shown in Figure 23, the adjustment of the position of the 
bounding box coincides with a vector displacement 2304 of the geometric center of 
the originally computed bounding rectangle 2306 to the computed center of mass 
2302 of the binary mask prepared from the user-defined subregion. The final 
bounding rectangle 2308 is shown in Figure 23 with solid edges. Feature signals, or, 
in other words, integrated, background-subtracted pixel intensities over regions of a 
scanned image of a microarray corresponding to features, are then computed, by an 
automated feature-extraction program, from the bounding rectangle 2308. 

Figure 24 illustrates one approach to computing feature-extractable 
regions for multiple user-defined feature-extractable regions. In Figure 24, the user 
has drawn three separate contours 2402, 2404, and 2406 enclosing subregions that the 
user considers to be feature extractable. As shown in Figure 24, the above-described 
technique may be employed for each separate feature-extractable subregion in order 
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to determine a bounding rectangle 2408, 2410, and 2412 for each separate feature- 
extractable subregion. An automated feature-extraction program can then extract 
signals from the three bounding rectangles 2408, 2410, and 2412. In alternative 
embodiments, a single bounding rectangle 2414 may be computed based on a single 
5 bit mask prepared based on the three feature-extractable subregions defined by a user. 
In other words, rather than treating each separate user-defined feature-extractable 
subregion separately, the three subregions may be employed, together, to prepare a 
single bit mask, from which a single bounding rectangle 2414 may be prepared. The 
latter approach provides greater simplicity at the expense of potentially including a 

10 rather large amount of damaged or defective microarray surface area. 

Figure 25 is a control-flow diagram for the partial microarray 
technique described above with reference to Figures 1 1-25. In the first step, a partial- 
array routine of a microarray data processing program receives one or more contours 
drawn by a user to indicate feature-extractable subregions within a displayed image of 

15 a microarray, in step 2502. Contour input is described above, with reference to Figure 
11. Next, in step 2504, ttie partial-array routine generates, in one embodiment, a 
binary mask for each separate feature-extractable region identified by the user or, in 
another embodiment, a single binary mask encompassing all feature-extractable 
subregions identified by the user. Binary mask generation is described above with 

20 reference to Figures 12-19, Then, in step 2506, the partial-array routine determines 
either a separate bounding box for each user-identified feature-extractable region, or a 
single bounding box encompassing all user-identified feature-extractable subregions 
by a construction process discussed above with reference to Figures 20-22. Next, in 
step 2508, the partial-array routine adjusts the position or positions of the one or more 

25 bounding boxes so that the geometric center of each bounding box coincides with the 
center of mass or centers of mass computed for the one or more binary masks. In one 
embodiment, each bounding box computed for each separate user-defined feature- 
extractable subregion is adjusted to have its geometric center coincide with a center of 
mass computed from a separate binary mask for the user-defined feature-extractable 

30 subregion. In an alternative embodiment, a single bounding rectangle is moved with 
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respect to a pixel grid so that the geometric center of the single bounding box 
coincides with a center of mass computed for a single binary mask encompassing all 
of the user-defined subregions. Finally, in step 2510, the microarray data processing 
system invokes an automated feature extraction routine to carry out the signal 
5 extraction from the feature-extractable subregions defined by one or more bounding 
boxes created in positions in steps 2506 and 2508. 

Although the present invention has been described in terms of a 
particular embodiment, it is not intended that the invention be limited to this 
embodiment. Modifications within the spirit of the invention will be apparent to those 

10 skilled in the art. For example, as discussed above, any number of nearest neighbor 
analysis techniques may be employed for creation of a binary mask from one or more 
user-defined feature-extractable subregions within the image of the microarray. 
Although a one-half maximum column or row value is employed, in the above- 
described embodiment, to compute the positions of the edges of the bounding box, 

15 alternative approaches may be employed, including inscribing the user-definer 
feature-extractable subregion or subregions within a rectangle. As discussed above, 
when a user defines more than one feature-extractable subregion, the individual 
subregions may be treated separately, or treated together by forming a single binary 
mask. The x and y axes within the pixel grid may be rather arbitrarily assigned, or 

20 may be assigned in order to partially inscribe a user-defined feature-extractable region 
within the positive quadrant. The above described embodiments employed bounding 
boxes for specifying regions of feature extractability, but bounding disks and other 
easily constructed shapes may be alternatively employed. A suitable bounding shape 
is one that can be constructed from one or a few parameters, and for which pixel 

25 membership can be computationally efficiently determined. 

The foregoing description, for purposes of explanation, used specific 
nomenclature to provide a thorough understanding of the invention. However, it 
will be apparent to one skilled in the art that the specific details are not required in 
order to practice the invention. The foregoing descriptions of specific embodiments 

30 of the present invention are presented for purpose of illustration and description. 
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They are not intended to be exhaustive or to limit the invention to the precise forms 
disclosed. Obviously many modifications and variations are possible in view of the 
above teachings. The embodiments are shown and described in order to best 
explain the principles of the invention and its practical applications, to thereby 
5 enable others skilled in the art to best utilize the invention and various embodiments 
with various modifications as are suited to the particular use contemplated. It is 
intended that the scope of the invention be defined by the following claims and their 
equivalents: 



